Formal Testing of Multimodal Interactive Systems
نویسندگان
چکیده
This paper presents a method for automatically testing interactive multimodal systems. The method is based on the Lutess testing environment, originally dedicated to synchronous software specified using the Lustre language. The behaviour of synchronous systems, consisting of cycles starting by reading an external input and ending by issuing an output, is to a certain extent similar to the one of interactive systems. Under this hypothesis, the paper presents our method for automatically testing interactive multimodal systems using the Lutess environment. In particular, we show that automatic test data generation based on different strategies can be carried out. Furthermore, we show how multimodality-related properties can be specified in Lustre and integrated in test oracles.
منابع مشابه
A Model-Based Approach for Engineering Multimodal Interactive Systems
Representing the behaviour of multimodal interactive systems in a complete, concise and nonambiguous way is still a challenge for formal description techniques. Indeed, multimodal interactive systems embed specific constraints that are either cumbersome or impossible to capture with classical formal description techniques. This is due to both the multiple facets of a multimodal system and the s...
متن کاملTesting the CARE Properties of Multimodal Applications by Means of a Synchronous Approach
Multimodal interactive applications support several interaction modalities (e.g., voice, gesture), which may be combined. As a result, designing and testing such applications is more complex than classical graphical applications. In this context, formal methods can make the development process more reliable. In this paper we focus on a testing approach dedicated to synchronous software. Althoug...
متن کاملSpecification Methods of Multimodal Interactive Systems
A Specification Method provides interface designers a model or notation to describe and record their design philosophy to facilitate evaluations as early as possible in pursuit of an optimum interface option. A number of formal notations have been developed to assist the description or analysis of interactive systems. This paper first simply reviews a subset of these notations from the perspect...
متن کاملA Formal Description of Low Level Interaction and its Application to Multimodal Interactive Systems
The lack of formal models for describing low-level interaction restricts programmers to interactors provided by toolkits. It impedes the construction of highly interactive systems and the design of new interaction styles, such as multimodal interaction. This article reports on our experience with formalising low-level graphical interaction. We propose primitives for event specification and hand...
متن کاملA generic formal specification of fusion of modalities in a multimodal HCI
This paper is an overview of a generic formal description allowing to encode multi-modal interactive systems, their behaviors and properties.
متن کامل